Extend SQLite schema and implement migration#636
Merged
xlight05 merged 1 commit intoballerina-platform:copilot-library-unifyfrom Feb 2, 2026
Merged
Extend SQLite schema and implement migration#636xlight05 merged 1 commit intoballerina-platform:copilot-library-unifyfrom
xlight05 merged 1 commit intoballerina-platform:copilot-library-unifyfrom
Conversation
VellummyilumVinoth
force-pushed
the
migration
branch
3 times, most recently
from
bab564b to
6df997a
Compare
VellummyilumVinoth
force-pushed
the
migration
branch
2 times, most recently
from
36809f6 to
94b02d7
Compare
VellummyilumVinoth
changed the base branch from
1.5.x
to
copilot-library-unify
VellummyilumVinoth
force-pushed
the
migration
branch
3 times, most recently
from
69fa243 to
d8c616e
Compare
VellummyilumVinoth
force-pushed
the
migration
branch
from
d8c616e to
24bc716
Compare
xlight05
requested changes
Feb 2, 2026
...extension/src/main/java/io/ballerina/flowmodelgenerator/extension/CopilotLibraryService.java
Show resolved
Hide resolved
...extension/src/main/java/io/ballerina/flowmodelgenerator/extension/CopilotLibraryService.java
Show resolved
Hide resolved
...extension/src/main/java/io/ballerina/flowmodelgenerator/extension/CopilotLibraryService.java
Show resolved
Hide resolved
xlight05
reviewed
Feb 2, 2026
|
|
||
| @Override | ||
| @Test(dataProvider = "data-provider") | ||
| public void test(Path config) throws IOException { |
Contributor
There was a problem hiding this comment.
About get_filtered_libraries.json, seems like we are asserting the response for http and another library.
We need to make this bit more readable on what we are testing here.
If the idea is to cover set of different libraries (and assume most cases are covered there), we shold have it in the test name.
I'd prefer having multiple test cases, (connector, library, http etc). The idea is that if we break something, we should catch that from tests. We should stratergically cover cases.
Contributor
|
Lets address PR comments in a separate PR to this dev branch. |
xlight05
merged commit 7beba82
into
ballerina-platform:copilot-library-unify
1 of 3 checks passed
xlight05
reviewed
Feb 2, 2026
...extension/src/main/java/io/ballerina/flowmodelgenerator/extension/CopilotLibraryService.java
Show resolved
Hide resolved
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
It Resolves wso2/product-ballerina-integrator#1909, wso2/product-ballerina-integrator#2251, wso2/product-ballerina-integrator#2252, wso2/product-ballerina-integrator#2253
This PR migrates the Copilot Library Service from static JSON-based library definitions to a SQLite search index–based architecture and improves package metadata extraction and service modeling.
The system now uses a database-driven approach for library and package information, making it more scalable, maintainable, and aligned with the BI package ecosystem.
Key Changes
New Service Implementation
search-index.sqliteinstead of static JSON filesNew Extension Classes
Enhanced Metadata Handling
Added new metadata models:
FieldData.javaReturnTypeData.javaTypeDefData.javaEnhanced
FunctionDataBuilder.javato improve function and type modelingThese changes improve representation of types, fields, function signatures, and return structures.
Database and Schema Updates
central-index.sqlitetosearch-index.sqliteas the primary data sourcesearch-index.sqlitesize increased (~17MB to ~18MB) due to richer metadatasearch-index.sqlschema definitiongeneric-services.jsonwith service definitions